Glass transition and random walks on complex energy landscapes 
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We present a simple mathematical model of glassy dynamics seen as a random walk in a directed, 
weighted network of minima taken as a representation of the energy landscape. Our approach 
gives a broader perspective to previous studies focusing on particular examples of energy landscapes 
obtained by sampling energy minima and saddles of small systems. We point out how the relation 
between the energies of the minima and their number of neighbors should be studied in connection 
with the network's global topology, and show how the tools developed in complex network theory 
can be put to use in this context. 
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The physics of glassy systems, the glass transition, and the slow dynamics ensuing at low temperatures have been 
the subject of a large interest in the past decades In particular, special attention has been devoted to the 
dynamics of a glassy system inside its configuration space: The idea is to understand glassy dynamics in terms of the 
exploration of a complex, rugged energy landscape in which the large number of metastable states limits the ability of 
the system to equilibrate. In the picture of an energy landscape partitioned into basins of attraction of local minima 
("traps"), the dynamics of the system is separated into harmonic vibrations inside traps and jumps between minima 
[2|. Several models of dynamical evolution through jumps between traps have been proposed and studied in order to 
reproduce the phenomenology of the glass transition, pointing out various ingredients of the ensuing slow dynamics 
Hill]- Moreover, several works have mapped the energy landscape of small systems and studied the dynamics through 
a master equation for the time evolution of the probability to be in each minimum. Systems thus considered range 
from clusters of Lennard- Jones atoms to proteins or heteropolymers 0, [H, H, 0] ■ 

The success of these approaches has recently brought about a number of studies focusing on the topology of the 
network defined by considering the minima as nodes and the possibility of a jump between two minima as a (weighted, 
directed) link Q . The small- world character of these networks has been pointed out @ , as well as strong heterogeneity 
in the number of links of each node (its degree). Scale- free distributions have been observed [T(|, and linked to scale- 
free distributions of the areas of the basins of attraction [Til . Il2| . Further investigations of various ener gy l andscapes 



(of Lennard- Jones atoms, proteins, spin glasses) have used complex network analysis tools 0, 0, [HI, [13|. 11411 . For 
instance, some works have exposed a logarithmic dependence of the energy of a minimum on its degree J ldl. Il2|| , or 
energy barriers increasing as a (small) power of the degree of a node Q. However, the relation between the energy and 
the degree of a minimum has never been systematically investigated. Moreover, no systematic study of the connection 
between the network of minima and the glassy dynamics has been performed, since the studies cited above are limited 
to small size systems. 

Here, we make an important first step to fill this gap by putting forward a simple mathematical model of a network 
of minima, through a generalization of Bouchaud's trap model 0, 0|. This framework allows to use the wide body of 
knowledge developed recently on dynamical phenomena in complex networks [l6[ to study the dynamics in a complex 
energy landscape as a random walk in a directed, weighted complex network. The corresponding heterogeneous 
mean-field (HMF) theory [l5j highlights the connection between network properties and dynamics, and shows in 
particular that the relationship between energy and degree of the minima is a crucial ingredient for the existence 
of a transition and the subsequent glassy phenomenology. This approach sheds light on the fact that scale-free 
structures and logarithmic relations between degrees and energies have been empirically found, and should stimulate 
more systematic investigations on this issue. It also puts previous studies of the dynamics in a network of minima 
obtained empirically in a broader perspective. 

We consider the well-known traps model of phase space consisting in N traps, i = 1, • • • , N, of random depths 
Ei extracted from a distribution p(E) @, 0|- The dynamics is given by random jumps between traps: The system, 
at temperature T = 1//3, remains in a trap for a time tq exp(/3i5) (where To is a microscopic timescale that we can 
set equal to 1), and then jumps to a new, randomly chosen trap; all traps are connected to each other, in a fully 
connected topology. Here we consider instead a — more realistic — case in which the traps form a network: Each trap i 
has depth Ei and number of neighbors fcj. The system, pictured as a random walker in this network, escapes from a 
trap of depth Ei towards one of the fcj neighboring traps of depth Ej with a rate r^_» j , which is a priori a function of 
both Ei and Ej. Possible rates include Metropolis ^ min (l, e ^ E i~ E ^) or Glauber fc" 1 / (l + e -P(Ej-Et)} ones. For 
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simplicity, we will stick here to the original definition of rates depending only on the initial trap, i.e. = e~@ Ei /fcj. 

In the fully connected trap model, all traps are equiprobable after a jump, so that the probability for the system to 
be in a trap of depth E is simply p(E), and the average time spent in a trap is (r) = J p(E)e /3E dE. Thus, a transition 
occurs between a high temperature phase in which (r) is finite and a low temperature phase with diverging (r) if 
and only if p(E) is of the form ~ exp(— (3qE) at large E (else the transition temperature is either or oo) [J]; the 
distribution of trapping times is then P(t) ~ r — i— r/!Tfa_ us see this translates when the network of minima is 
not fully connected. In this case, it is convenient to divide the nodes in degree classes, as it is usual in the framework 
of the HMF theory [l5[. We further assume that the depth of a minimum and its degree are related: Ei = /(fcj) 
where the function f(k) does not depend on i and is a characteristic of the model. The time spent in a trap of degree 
k is then 77. = e^^ k \ and the transition rate T*j_> 3 - between two traps can be written as a function of the endpoints' 
degrees fcj and kj. It is important to recall that, in the steady state, the probability for a random walker to find itself 
on a node of degree k is kP(k) / (k), where P(k) is the degree distribution of the network and (k) is the average degree 
[Tj ] . The average rest time before a hop is therefore 

(t) = (k)- l Y,kP(k)e p}{k) . (1) 

k 

It is then clear that the presence of a finite transition temperature at which (r) becomes infinite results from an 
interplay between the topology of the underlying network and the relation between traps' depth and degree. For 
instance, for a scale free distribution P(k) ~ /c~ 7 , a finite transition temperature is obtained if and only if f(k) is of 
the form Eolog(k): (t) is then finite (in an infinite system) for T > T c = Eq/^ — 2), and infinite for T < T c . For P(k) 
behaving instead as e~ ak , f(k) has to be of the form Eok a for a transition to occur. Thus, although important, the 
study of the topology of the network of minima is not enough to understand the dynamical properties of the system, 
and more attention should be paid to the energy/connectivity relation. 

To gain further insight into the dynamics of the system we can write, within the HMF approach, the rate equation 
for the probability Pk{t) that a given vertex of degree k hosts the random walker at physical time t. Since the walker 
escapes a trap with rate per unit time Tk = 1/Tfc, we have 

= -r kP k{t) + kY,P{k'\k)r{k' fc)Ptf(t) (2) 

where P(k'\k) is the conditional probability that a random neighbor of a node of degree k has degree k' @. In the 
steady state, dtPk(t) = 0, the solution of Eq. © for any correlation pattern P(k'\k) is [HI 

rkPk ~ k , (3) 

and the normalized equilibrium distribution reads 

Note that the probability for the random walker to be in any vertex of degree k is then P eq (k) = NP(k)p^ q . Since 
(krk) = ^fc kP(k)e@f( k \ the conclusion is the same as before: A normalizablc equilibrium distribution exists indeed 
if and only if (fcTfc) < 00, and the presence of a transition at a finite temperature T c is determined by the interplay 
between P(k) and f(k). 

In any finite system, the distribution P eq {k) exists, and the probability that the random walker is in a node of degree 
k at time t w , P(k; t w ) = NP(k)pk(t w ), converges to P eq (k) after a certain equilibration time. It is interesting to study 
this evolution in the low temperature regime, when it exists. Let us consider the case of a scale-free network with 
P(k) ~ fc -7 [f| and f(k) = Eo\og(k), i.e., Tfe = k^ E " . In numerical experiments, the walker explores an underlying 
network generated according to the Uncorrelated Configuration Model [l7| , and spends in each node of degree k an 
amount of time extracted from the distribution Pijk) = exp(— t/r^/Tk- Figure [T] shows how P(k;t w ) evolves from 
the distribution kP(k)/ (k) at short times, corresponding to the degree distribution of a node reached after a random 
jump, to P eq (k) ~ / s 1 +' 3S o-7 (obtained from Eq. ^) at long times: The small degree region equilibrates first, and a 
progressive equilibration of larger and larger degree regions takes place at larger times. Small degrees correspond in 
fact to shallow minima, which take less time to explore, while large degree nodes are deep traps which take longer to 
equilibrate [nj. At time t w , one can therefore consider that the nodes of degree smaller than a certain k w are "at 
equilibrium", while the larger nodes are not. Considering that the total time t w is the sum of the trapping times of 
the visited nodes, which is dominated by the longest one k^ E ° , we obtain K, - d /(/5Eo) • Fi gureQ] shows indeed that 
the whole non-equilibrium distribution can be cast into the scaling form [2(| 

p{k-,t w ) = t-y^F[k/t]/^) ( 5 ) 
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FIG. 1: Evolution of P(k;t w ) for an uncorrelated scale-free network. Here N = 10 6 (k c — 10 3 ), 7 = 3, /3Eo = 2 so that 
P{k\t w ) ~ k~ 2 at short times and P eq (k) ~ Inset: tl/ 2 P(k;t w ) vs k/tl/ 2 for t«, < teg ~ 10 6 . 



where F is a scaling function such that F(x) ~ x i+ P E ° 7 at small x and -F(x) ~ x 1 7 at large x. This evolution takes 
place until the largest nodes, of degree k c , equilibrate. For an uncorrelated scale-free network, k c ~ A 1 / 2 so that the 
equilibration time is t eq ~ k^ E ° - N 0E °/ 2 . 

The evolution of P(fc; t w ) at low temperature corresponds to the aging dynamics of the system, which is exploring 
deeper and deeper traps. This dynamics is also customarily investigated through a two-time correlation function 
C(t w + t,t w ) between the states of the system at times t w and t w + t, defined as the the average probability that a 
particle has not changed trap between t w and t w +t 0, 0| : this amounts to considering that the correlation is 1 within 
one trap and between distinct traps. The probability that a walker remains in trap i a time larger than t is simply 
given by exp(— t/rj), so that 

C(t w +t,t w )= I dk P{k-t w )e~ t / T \ (6) 



where we have used the continuous degree approximation, replacing discrete sums over k by integrals. For scale-free 
networks, using the scaling form |5]). it is then straightforward to obtain that the correlation function obeys the 
so-called "simple" aging C(t w +t,t w ) = g(t/t w ), as in the original trap model [J (Fig. [2]). 

Aging properties of the system can be measured also through the average time t eS c(tw) required by the random 
walker to escape from the node it occupies at time t w . In other words we define t esc = (f) —t w , where t' > t w is the 
time of the first jump performed by the walker after t w , which gives t esc (t w ) = J dk TkP(k;t w ). For small t w with 
respect to the equilibration time, t esc is growing due to the evolution of P(k; t w ). At long enough times, in any finite 
system, pk(t w ) — > p e k q so that 

r „ kPtkypfw 

tesc{t w -> co) = I dk r . (7) 

J {kTk) 

Interestingly, this formula shows that, whenever P(k) and f(k) are such that a finite transition temperature T c exists, 
t e sc(t w — > co) actually diverges at 2T C . The existence of a diverging timescale at 2T C was in fact already noted in the 
original mean-field trap model 

We can also consider how t esc diverges with the system size depending on temperature. For instance, with P(k) ~ 
fc -7 and f(k) = E log(fc), we have t esc (t w ->• co) = t%% c = (k 1+2pEa )/(k 1+l3Eo ). For uncorrelated networks, the cut-off 
of P(k) scales as k c ~ N 1 / 2 , so that 

NP E °/ 2 if (3E Q > 1 -2 

"TOT- lf /3£o=7-2 

*Sc - { iV(2+2/3Bo-7)/2 if 7_2 < ^ < ^ _ 3 . (8) 

In N if /i^o = ^ 

const. if /3F0 < ^ 

Figure [5] displays a numerical check of these predictions. For an exponential degree distribution P(k) ~ e~ k / m , with 
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FIG. 2: Top: average escape time t e3C (t w ) divided by the large time prediction Eq. JHJ, for various N and j3. Bottom: 
C(t w + t,t w ) vs t/t w for an uncorrelated scale-free network of N = 10 6 minima. Here 7 = 3, [3Eo = 4. Inset: C vs t. 



f(k) = E k/m, we obtain analogously t e e q sc 



20E Q k , ffgpfc 

(fee m ) / (ke m }, and, considering that fc c 



m In iV we obt ain 



+e<7 

esc 



N 2f)E -l 

IniV 
N 2/3E -1 

IniV 
const. 



if (3E > 1 

if /3£ = 1 

if 1/2 < j3E a < 1 

if /3£ - 1/2 

if /3£ < 1/2 



(9) 



We finally turn to the investigation of a quantity of particular relevance in random walks on networks, namely 
the mean first passage time (MFPT) [l8|. Since the way in which the phase space is explored is crucial for the 
dynamical properties of the system, it is also interesting in the present context to measure the MPFT averaged over 
random origin-destination pairs, ($mfpt)- This procedure was for instance used in Q to extract a global relaxation 
time, whose temperature dependence was tentatively fitted to a Vogel-Tammann-Fulcher form exp(A/ (T — To)), with 
however To *C T c . The framework put forward above allows in fact to rationalize this result. The average number of 
hops performed by a random walker between two nodes, Hmfpt, does not indeed depend on the temperature. On 
the other hand, the temperature determines the interplay between the physical time and the number of hops: the 
time needed to perform H hops is 



(10) 



where Tj = e 13 ^^ is the residence time in trap i. Therefore, 

(tMFPr) = Hmfpt(t), 



(11) 



where (r) depends on temperature, P(k) and f(k) as given by Eq. (JTJ) . Let us consider the concrete example of an 
uncorrelated scale-free network with degree distribution P(k) ~ fc~ 7 , cut-off k c ~ TV 1 / 2 , and f(k) = Eq log(fe). In the 
continuous degree approximation, this leads to 



Since Hmfpt is of order N [18|, we obtain 



/ N if PE < 7 - 2 

(t MFPT ) _ < N2+mo ^ )/2 . f ^ > 7 _ 2 



(12) 



(13) 



In the case of an exponential degree distribution, 



(r) 



dkke^ E < 



b-l)fc/m _ (/3Tp - 1) 



fee 



— 3 — 



o (/3B -l)^ 



5 




P 



FIG. 3: MFPT for scale-free uncorrelated random networks. Here E = 1. Top: 7 = 2.2, N = 10 5 ; both Eq.([T3]) and a VTF 
fit (with T ?a 0.023) are shown. Bottom: 7 = 3 and various network sizes. For (3 < p c = 1, r <x N, while r oc N 2+{J3E °~"< )/2 
for /3 > p c . 



and, using fc c ~ mlogiV, wc obtain (t MFPT ) ~ AT for /3£b < 1 and (t MFPT ) ~ A^ for /3£b > 1- Figure [3] shows 
the comparison of numerical data with the prediction of Eq. (|13l) . The top panel also shows how, interestingly, a 
Vogel-Tammann-Fulcher form exp(A/(T — To)) can also fit the data; however, the value of To ~ 0.023 has here no 
clear significance, while Eq. (|13[) provides a straightforward interpretation of the data. 

In summary, we have put forward a simple mathematical model for the dynamics of glassy systems, seen as a 
random walk in a complex energy landscape. This work puts previous studies on the topology of the network of 
minima in a broader perspective and represents a first step towards a systematic integration of tools and concepts 
developed in complex network theory to the description of glassy dynamics in terms of the exploration of a phase space 
seen as a network of minima. It opens the way to studies on how network structures (such as community structures 
or bottlenecks, large clustering, non-trivial correlations) impact the dynamics. Other possible modifications of our 
model include taking into account fluctuations of the energies within a degree class (using for instance conditional 
energy distributions P(E\k) instead of a relation E = f(k)), and other transition rates r(k —* k'). A preliminary 
analysis shows that, for Glauber rates, the same phenomenology and the same necessary interplay between energy 
and degree described here are obtained. Wc also hope that this work will stimulate further detailed investigations on 
the relation between minima depth and connectivity. 
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